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A system and method for detecting 
diagnostic cells and cells having 
malignancy-associated changes are 
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and cells having malignancy-associated 
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SYSTEM AND METHOD FOR AUTOMATICALLY DETECTING 
MALIGNANT CELLS AND CELLS HAVING MALIGNANCY- ' 
ASSOCIATED CHANGES 
Related Applications 
The present application is a continuation-in-part of copending applications 
Serial No. 08 /888,434 filed July 7, 1997, entitled COMPOSITION AND 

METHOD FOR STAINING CELLULAR DNA, Attorney Docket No. ONIC1 10769, 
and Serial No. 08/644,893 filed May 10, 1996, which was a continuation-in-part of 
Serial No. 08/425,257 filed April 17, 1995, which was a continuation of Serial No. 
08/182,453 filed January 10, 1994, which was a continuation-in-part of Serial No. 
07/961,596 filed October 14, 1992, the disclosures of which are incorporated by 
reference. The benefit of the filing dates of the previous applications are claimed 
under 35 U.S.C. § 120. 

Field of the Invention 

The present invention relates to image cytometry systems and cell 
classification in general, and in particular to automated systems for detecting 
malignant cells and cells having malignancy-associated changes. 

Background of the Invention 

The most common method of diagnosing cancer in patients is by obtaining a 
sample of the suspect tissue and examining it under a microscope for the presence of 
obviously malignant cells. While this process is relatively easy when the location of 
the suspect tissue is known, it is not so easy when there is no readily identifiable 
tumor or pre-cancerous lesion. For example, to detect the presence of lung cancer 
from a sputum sample requires one or more relatively rare cancer cells to be present in 
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the sample. Therefore patients having lung cancer may not be diagnosed properly if 
the sample does not accurately reflect the conditions of the lung. 

Malignancy-associated changes (MACs) are subtle changes that are known to 
take place in the nuclei of apparently normal cells found near cancer tissue. In 
5 addition, MACs have been detected in tissue found near pre-cancerous lesions. 
Because the cells exhibiting MACs are more numerous than the malignant cells, 
MACs offer an additional way of diagnosing the presence of cancer, especially in 
cases where no cancerous cells can be located. 

Despite the ability of researchers to detect MACs in patients known to have 

10 cancer or a pre-cancerous condition, MACs have not yet achieved wide acceptance as 
a screening tool to determine whether a patient has or will develop cancer. 
Traditionally, MACs have been detected by carefully selecting a cell sample from a 
location near a tumor or pre-cancerous lesion and viewing the cells under relatively 
high magnification. However, it is believed that the malignancy-associated changes 

15 that take place in the cells are too subtle to be reliably detected by a human 
pathologist working with conventional microscopic equipment, especially when the 
pathologist does not know beforehand if the patient has cancer or not. For example, a 
malignancy-associated change may be indicated by the distribution of DNA within the 
nucleus coupled with slight variations in the shape of the nucleus edge. However, 

20 nuclei from normal cells may exhibit similar types of changes but not to the degree 
that would signify a MAC. Because human operators cannot easily quantify such 
subtle ceil changes, it is difficult to determine which cells exhibit MACs. 
Furthermore, the changes which indicate a MAC may vary between different types of 
cancer, thereby increasing the difficulty of detecting them. 

25 Summary of the Invention 

The present invention is a system for automatically detecting malignancy- 
associated changes in cell samples. The system includes a digital microscope having a 
CCD camera that is controlled by and interfaced with a computer system. Images 
captured by the digital microscope are stored in an image processing board and 

30 manipulated by the computer system to detect the presence of malignancy-associated 
changes (MACs). At the present state of the art, it is believed that any detection of 
MACs requires images to be captured at a high spatial resolution, a high photometric 
resolution, that all information coming from the nucleus is in focus, that all 
information belongs to the nucleus (rather than some background), and that there is 
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an accurate and reproducible segmentation of the nucleus and nuclear material. Each 
of these steps is described in detail below. 

To detect the malignancy-associated changes, a cell sample is obtained and 
stained to identify the nuclear material of the cells and is imaged by the microscope. 
5 The stain is stoichiometric and specific to DNA only. The computer system then 
analyzes the image to compute a histogram of all pixels comprising the image. First, 
an intensity threshold is set that divides the background pixels from those comprising 
the objects in the image. All pixels having an intensity value less than the threshold 
are identified as possible objects of interest while those having an intensity value 

10 greater than the threshold are identified as background and are ignored. 

For each object located, the computer system calculates the area, shape and 
optical density of the object. Those objects that could not possibly be cell nuclei are 
ignored. Next, the image is decalibrated, i.e., corrected by subtracting an empty 
frame captured before the scanning of the slide from the current frame and adding 

15 back an offset value equal to the average background light level. This process 
corrects for any shading of the system, uneven illumination, and other imperfections 
of the image acquisition system. Following decalibration, the images of all remaining 
objects must be captured in a more precise focus. This is achieved by moving the 
microscope in the stage z-direction in multiple focal planes around the approximate 

20 frame focus. For each surviving object a contrast function (a texture feature) is 
calculated. The contrast function has a peak value at the exact focus of the object. 
Only the image at the highest contrast value is retained in the computer memory and 
any object which did not reach such a peak value is also discarded from further 
considerations. 

25 Each remaining in-focus object on the image is further compensated for local 

absorbency of the materials surrounding the object. This is a local decalibration which 
is similar to that described for the frame decalibration described above, except that 
only a small subset of pixels having an area equal to the area of a square into which 
the object will fit is corrected using an equivalent square of the empty frame. 

30 After all images are corrected with the local decalibration procedure, the edge 

of the object is calculated, i.e., the boundary which determines which pixels in the 
square belong to the object and which belong to the background. The edge 
determination is achieved by the edge-relocation algorithm. In this process, the edge 
of the original mask of the first contoured frame of each surviving object is dilated for 

35 several pixels inward and outward. For every pixel in this frame a gradient value is 
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calculated, i.e., the sum and difference between all neighbor pixels touching the pixel 
in question. Then the lowest gradient value pixel is removed from the rim, subject to 
the condition that the rim is not ruptured. The process continues until such time as a 
single pixel rim remains. To ensure that the proper edge of an object is located, this 
5 edge may be again dilated as before, and the process repeated until such time as the 
new edge is identical to the previous edge. In this way the edge is calculated along 
the highest local gradient. 

The computer system then calculates a set of feature values for each object. 
For some feature calculations the edge along the highest gradient value is corrected by 

10 either dilating the edge by one or more pixels or eroding the edge by one or more 
pixels. This is done such that each feature achieves a greater discriminating power 
between classes of objects and is thus object specific. These feature values are then 
analyzed by a classifier that uses the feature values to determine whether the object is 
an artifact or is a cell nucleus. If the object appears to be a cell nucleus, then the 

15 feature values are further analyzed by the classifier to determine whether the nucleus 
exhibits malignancy-associated changes. Based on the number of objects found in the 
sample that appear to have malignancy-associated changes and/or an overall 
malignancy-associated score, a determination can be made whether the patient from 
whom the cell sample was obtained is healthy or harbors a malignant growth. 

20 In another aspect, the present invention provides a system and method for 

automatically detecting diagnostic cells and cells having malignancy-associated 
changes. The system is an automated classifier and includes, in addition to a 
microscope, camera, image digitizer, and computer system for controlling and 
interfacing these components, a primary classifier for preliminarily classifying a 

25 cytological specimen and a secondary classifier for classifying those portions of the 
cytological sample initially classified by the primary classifier. The primary classifier 
distinguishes and selects epithelial cells from among abnormal cells, such as diagnostic 
cells, in the cell sample based on one set of features. The secondary classifier 
indicates whether the selected epithelial cells are normal or have malignancy- 

30 associated changes based on a second set of features. The system and method are 
particularly useful for detecting diagnostic cells and cells having malignancy- 
associated changes in cell samples obtained from a variety of sources including cells 
obtained from bronchial specimens such as lung sputum. 

In other embodiments, the present invention provides a method for detecting 

35 epithelial cells in a cell sample and a method for detecting cells having malignancy- 
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associated changes from among epithelial cells. In another embodiment, a method for 
predicting whether a patient will develop cancer is provided. 

Brief Description of the Drawings 
The foregoing aspects and many of the attendant advantages of this invention 
5 will become more readily appreciated as the same becomes better understood by 
reference to the following detailed description, when taken in conjunction with the 
accompanying drawings, wherein: 

FIGURE 1 is a block diagram of the MAC detection system according to the 
present invention; 

10 FIGURES 2A-2C are a series of flow charts showing the steps performed by 

the present invention to detect MACs; 

FIGURE 3 is an illustrative example of a histogram used to separate objects of 
interest from the background of a slide; 

FIGURE 4 is a flow chart of the preferred staining procedure used to prepare 
15 a cell sample for the detection of MACs; 

FIGURES 5 and 6 are illustrations of objects located in an image; 
FIGURES 7A-7F illustrate how the present invention operates to locate the 
edge of an object; 

FIGURES 8 and 9 are diagrammatic illustrations of a classifier that separates 
20 artifacts from cell nuclei and MAC nuclei from non-MAC nuclei; 

FIGURE 10 is a flow chart of the steps performed by the present invention to 
determine whether a patient is normal or abnormal based on the presence of MACs; 

FIGURE 1 1 is a diagrammatic illustration of an automated classifier system of 
the present invention; 

25 FIGURE 12 is a flow chart of the binary decision tree employed by the 

primary classifier to classify epithelial cells in a cell sample, where "DI" refers to DNA 
index (normal = 1.0), "norm cells" refers to normal cells, "junk" refers to debris, 
"lymph" refers to lymphocytes, "abn cells" refers to abnormal epithelial cells, "dust" 
refers to pulmonary alveolar macrophages, "polys" refers to polymorphonuclear 

30 neutrophilic leukocytes, and "eos" refers to polymorphonuclear eosinophilic 
leukocytes; and 

FIGURE 13 is a flow chart of the binary decision tree employed by the 
secondary classifier to classify cells having malignancy-associated changes (i.e., MAC 
positive cells) among epithelial cells in a cell sample. 
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Detailed Description of the Preferred Embodiment 
As described above, the present invention is a system for automatically 
detecting malignancy-associated changes (MACs) in the nuclei of cells obtained from 
a patient. From the presence or absence of MACs, a determination can be made 
5 whether the patient has a malignant cancer. 

A block diagram of the MAC detection system according to the present 
invention is shown in FIGURE 1. The system 10 includes a digital microscope 12 
that is controlled by and interfaced with a computer system 30. The microscope 12 
preferably has a digital CCD camera 14 employing a scientific CCD having square 
10 pixels of approximately 0.3 urn by 0.3 urn size. The scientific CCD has a 100% fill 
factor and at least a 256 gray level resolution. The CCD camera is preferably 
mounted in the primary image plane of a planar objective lens 22 of the 
microscope 12. 

A cell sample is placed on a motorized stage 20 of the microscope whose 
15 position is controlled by the computer system 30. The motorized stage preferably has 
an automatic slide loader so that the process of analyzing slides can be completely 
automated. 

A stable light source 18, preferably with feedback control, illuminates the cell 
sample while an image of the slide is being captured by the CCD camera. The lens 22 
20 placed between the sample 16 and the CCD camera 14 is preferably a 20x/0.75 
objective that provides a depth of field in the range of 1-2 urn that yields a distortion- 
free image. In the present embodiment of the invention, the digital CCD camera 14 
used is the Microimager™ produced by Xillix Technologies Corp. of Richmond, 
B.C., Canada. 

25 The images produced by the CCD camera are received by an image processing 

board 32 that serves as the interface between the digital camera 14 and the computer 
system 30. The digital images are stored in the image processing board and 
manipulated to facilitate the detection of MACs. The image processing board creates 
a set of analog video signals from the digital image and feeds the video signals to an 

30 image monitor 36 in order to display an image of the objects viewed by the 
microscope. 

The computer system 30 also includes one or more input devices 38, such as a 
keyboard and mouse, as well as one or more peripherals 42, such as a mass digital 
storage device, a modem or a network card for communicating with a remotely 
35 located computer, and a monitor 40. 
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FIGURES 2A-2C show the steps performed by the system of the present 
invention to determine whether a sample exhibits MACs or not. Beginning with a 
step 50, a cell sample is obtained. Cells may be obtained by any number of 
conventional methods such as biopsy, scraping, etc. The cells are affixed to a slide 
5 and stained using a modified Feulgen procedure at a step 52 that identifies the nuclear 
DNA in the sample. The details of the staining procedure are shown in FIGURE 4 
and described in detail below. 

At step 54, an image of a frame from the slide is captured by the CCD camera 
and is transferred into the image processor. In this process, the CCD sensor within 

10 the camera is cleared and a shutter of the camera is opened for a fixed period that is 
dependent on the intensity of the light source 18. After the image is optimized 
according to the steps described below, the stage then moves to a new position on the 
slide such that another image of the new frame can be captured by the camera and 
transferred into the computer memory. Because the cell sample on the slide occupies 

15 a much greater area than the area viewed by the microscope, a number of slide images 
are used to determine whether the sample is MAC-positive or negative. The position 
of each captured image on the slide is recorded in the computer system so that the 
objects of interest in the image can be found on the slide if desired. 

Once an image from the slide is captured by the CCD camera and stored in the 

20 image processing board, the computer system determines whether the image produced 
by the CCD camera is devoid of objects. This is performed by scanning the digital 
image for dark pixels. If the number of dark pixels, i.e., those pixels having an 
intensity of the background intensity minus a predetermined offset value, is fewer than 
a predetermined minimum, the computer system assumes that the image is blank and 

25 the microscope stage is moved to a new position at step 60 and a new image is 
captured at step 54. 

If the image is not blank, then the computer system attempts to globally focus 
the image. In general, when the image is in focus, the objects of interest in the image 
have a maximum darkness. Therefore, for focus determination the height of the stage 
30 is adjusted and a new image is captured. The darkness of the object pixels is 
determined and the process repeats until the average darkness of the pixels in the 
image is a maximum. At this point, the computer system assumes that global focus 
has been obtained. 

After performing the rough, global focus at step 62, the computer system 
35 computes a histogram of all pixels. As shown in FIGURE 3, a histogram is a plot of 
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the number of pixels at each intensity level. In the Microimager™-based microscope 
system, each pixel can have an intensity ranging from 0 (maximum darkness) to 
255 (maximum brightness). The histogram typically contains a first peak 90 that 
represents the average intensity of the background pixels. A second, smaller peak 92 
5 represents the average intensity of the pixels that comprise the objects. By calculating 
a threshold 94 that lies between the peaks 90 and 92, it is possible to crudely separate 
the objects of interest in the image from the background. 

Returning to FIGURE 2B, the computer system computes the threshold that 
separates objects in the image from the background at step 68. At a step 72, ail pixels 

10 in the cell image having an intensity less than the threshold value are identified. The 
results of step 72 are shown in FIGURE 5. The frame image 200 contains numerous 
objects of interest 202, 204, 206 . 226. Some of these objects are cell nuclei, /which 
will be analyzed for the presence of MACs, while other objects are artifacts such as 
debris, dirt particles, white blood cells, etc., and should be removed from the cell 

15 image. 

Returning to FIGURE 2B, once the objects in the image have been identified, 
the computer system calculates the area, shape (sphericity) and optical density of each 
object according to formulas that are described in further detail below. At a step 76, 
the computer system removes from memory any objects that cannot be cell nuclei. In 

20 the present embodiment of the invention those objects that are not possibly cell nuclei 
are identified as having an area greater than 2,000 jim 2 , an optical density less than 1 c 
(i.e., less that 1/2 of the overall chromosome count of a normal individual) or a shape 
or sphericity greater than 4. 

The results of step 76 are shown in FIGURE 6 where only a few of the 

25 previously identified objects of interest remain. Each of the remaining objects is more 
likely to be a cell nuclei that is to be examined for a malignancy-associated change. 

Again returning to FIGURE 2B, after removing each of the objects that could 
not be a cell nucleus, the computer system determines whether there are any objects 
remaining by scanning for dark pixels at step 78. If no objects remain, the computer 

30 system returns to step 54, a new image on the slide is captured and steps 54-76 are 
repeated. 

If there are objects remaining in the image after the first attempt at removing 
artifacts at step 76, the computer system then compensates the image for variations in 
illumination intensity at step 80. To do this, the computer system recalls a calibration 
35 image that was obtained by scanning in a blank slide for the same exposure time that 
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was used for the image of the cells under consideration. The computer system then 
begins a pixel -by-pixel subtraction of the intensity values of the pixels in the 
calibration image obtained from the blank slide from the corresponding pixels found in 
the image obtained from the cell sample. The computer system then adds a value 
5 equal to the average illumination of the pixels in the calibration image obtained from 
the blank slide to each pixel of the cell image. The result of the addition illuminates 
the cell image with a uniform intensity. 

Once the variations in illumination intensity have been corrected, the computer 
system attempts to refine the focus of each object of interest in the image at step 82 

10 (FIGURE 2C). The optimum focus is obtained when the object has a minimum size 
and maximum darkness. The computer system therefore causes the stage to move a 
predefined amount above the global focus position and then moves in a sequence of 
descending positions. At each position the CCD camera captures an image of the 
frame and calculates the area and the intensity of the pixels comprising the remaining 

15 objects. Only one image of each object is eventually stored in the computer memory 
coming from the position in which the pixels comprising the object have the maximum 
darkness and occupy a minimum area. If the optimum focus is not obtained after a 
predetermined number of stage positions, then the object is removed from the 
computer memory and is ignored. Once the optimum focus of the object is 

20 determined, the image received from the CCD camera overwrites those pixels that 
comprise the object under consideration in the computer's memory. The result of the 
local focusing produces a pseudo-focused image in the computer's memory whereby 
each object of interest is ultimately recorded at its best possible focus. 

At a step 84, the computer system determines whether any in-focus objects in 

25 the cell image were found. If not, the computer system returns to step 54 shown in 
FIGURE 2A whereby the slide is moved to another position and a new image is 
captured. 

Once an image of the object has been focused, the computer system then 
compensates for local absorbency of light near the object at a step 85. To do this, the 

30 computer system analyzes a number of pixels within a box having an area that is larger 
than the object by two pixels on all sides. An example of such a box is the box 207 
shown in FIGURE 6. The computer system then performs a pixel-by-pixel 
subtraction of the intensity values from a corresponding square in the calibration 
image obtained from the blank slide. Next the average illumination intensity of the 

35 calibration image is added to each pixel in the box surrounding the object. Then the 
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average intensity value for those pixels that are in the box but are not part of the 
object is determined and this local average value is then subtracted from each pixel in 
the box that encloses the object. 

Once the compensation for absorbency around the object has been made, the 
5 computer system then determines a more precise edge of each remaining object in the 
cell image at step 86. The steps required to compute the edge are discussed in further 
detail below. 

Having compensated for local absorbency and located the precise edge of the 
object, the computer system calculates a set of features for each remaining object at a 
10 step 87. These feature values are used to further separate artifacts from cell nuclei as 
well as to identify nuclei exhibiting MACs. The details of the feature calculation are 
described below. 

At a step 88, the computer system runs a classifier that compares the feature 
values calculated for each object and determines whether the object is an artifact and, 
15 if not, whether the object is a nucleus that exhibits MACs. 

At a step 90, the pseudo-focus digital image, the feature calculations and the 
results of the classifier for each in-focus object are stored in the computer's memory. 

Finally, at a step 92, the computer system determines whether further scans of 
the slide are required. As indicated above, because the size of each cell image is much 
20 less than the size of the entire slide, a number of cell images are captured to ensure 
that the slide has been adequately analyzed. Once a sufficient number of cell images 
have been analyzed, processing stops at step 94. Alternatively, if further scans are 
required, the computer system loops back to step 54 and a new image of the cell 
sample is captured. 

25 As indicated above, before the sample can be imaged by the digital 

microscope, the sample is stained to identify the nuclear material. 

FIGURE 4 is a flow chart of the steps used to stain the cell samples. 
Beginning at a step 100, the cell sample is placed on a slide, air dried and then soaked 
in a 50% glycerol solution for four minutes. The cell is then washed in distilled water 

30 for two minutes at a step 102. At a step 104, the sample is bathed in a 50% ethanol 
solution for two minutes and again washed with distilled water for two minutes at a 
step 106. The sample is then soaked in a Bohm-Sprenger solution for 30 minutes at a 
step 108 followed by washing with distilled water for one minute at a step 110. At 
step 112, the sample is soaked in a5NHCl solution for 45 minutes and rinsed with 

35 distilled water for one minute at a step 1 14. The sample is then stained in a thionine 
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stain for 60 minutes at a step 116 and rinsed with distilled water for one minute at a 
step 118. 

At step 120, the sample is soaked in a bisulfite solution for six minutes 
followed by a rinse for one minute with distilled water at a step 122. Next, the sample 
5 is dehydrated in solutions of 50%, 75% and 100% ethanol for approximately 10 
seconds each at a step 124. The sample is then soaked in a final bath of xylene for 
one minute at a step 126 before a cover slip is applied at a step 128. After the cell 
sample has been prepared, it is ready to be imaged by the digital microscope and 
analyzed as described above. 

10 FIGURES 7A-7F illustrate the manner in which the present invention 

calculates the precise edge of an object. As shown in FIGURE 7 A, an object 230 is 
comprised of those pixels having an intensity value less than the background/object 
threshold which is calculated from the histogram and described above. In order to 
calculate the precise edge, the pixels lying at the original edge of the object are dilated 

15 to form a new edge region 242. A second band of pixels lying inside the original edge 
are also selected to form a second edge region 244. The computer system then 
assumes that the true edge is somewhere within the annular ring bounded by the edge 
regions 242 and 244. In the presently preferred embodiment of the invention, the 
annular ring has a width of approximately ten pixels. To determine the edge, the 

20 computer calculates a gradient for each pixel contained in the annular ring. The 
gradient for each pixel is defined as the sum of the differences in intensity between 
each pixel and its surrounding eight neighbors. Those pixels having neighbors with 
similar intensity levels will have a low gradient while those pixels at the edge of the 
object will have a high gradient. 

25 Once the gradients have been calculated for each pixel in the annular ring, the 

computer system divides the range of gradients into multiple thresholds and begins 
removing pixels having lower gradient values from the ring. To remove the pixels, 
the computer scans the object under consideration in a raster fashion. As shown in 
FIGURE 7C, the raster scan begins at a point A and continues to the right until 

30 reaching a point B. During the first scan, only pixels on the outside edge, i.e., pixels 
on the edge region 242, are removed. The computer system then scans in the 
opposite direction by starting, for example, at point D and continuing upwards to 
point B returning in a raster fashion while only removing pixels on the inside edge 
region 244 of the annular ring. The computer system then scans in another 

35 orthogonal direction— for example, starting at point C and continuing in the direction 
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of point D in a raster fashion, this time only removing pixels on the outside edge 
region 242. This process continues until no more pixels at that gradient threshold 
value can be removed. 

Pixels are removed from the annular ring subject to the conditions that no 
5 pixel can be removed that would break the chain of pixels around the annular ring. 
Furthermore, adjacent pixels cannot be removed during the same pass of pixel 
removal. Once all the pixels are removed having a gradient that is less than or equal 
to the first gradient threshold, the threshold is increased and the process starts over. 
As shown in FIGURE 7D, the pixel-by-pixel removal process continues until a single 

10 chain of pixels 240' encircles the object in question. 

After locating the precise edge of an object, it is necessary to determine 
whether those pixels that comprise the edge should be included in the object. To do 
this, the intensity of each pixel that comprises the newly found edge is compared with 
its eight neighbors. As shown in FIGURE 7E, for example, the intensity of a 

15 pixel 246 is compared with its eight surrounding pixels. If the intensity of pixel 246 is 
less than the intensity of pixel 250, then the pixel 246 is removed from the pixel chain 
as it belongs to the background. To complete the chain, pixels 248 and 252 are added 
so that the edge is not broken as shown in FIGURE 7F. After completing the edge 
relocation algorithm and determining whether each pixel should be included in the 

20 object of interest, the system is ready to compute the feature values for the object. 

Once the features have been calculated for each in-focus object, the computer 
system must make a determination whether the object is a cell nucleus that should be 
analyzed for malignancy-associated changes or is an artifact that should be ignored. 
As discussed above, the system removes obvious artifacts based on their area, shape 

25 (sphericity) and optical density. However, other artifacts may be more difficult for the 
computer to recognize. To further remove artifacts, the computer system uses a 
classifier that interprets the values of the features calculated for the object. 

As shown in FIGURE 8, a classifier 290 is a computer program that analyzes 
an object based on its feature values. To construct the classifier two databases are 

30 used. The first database 275 contains feature values of objects that have been imaged 
by the system shown in FIGURE 1 and that have been previously identified by an 
expert pathologist as non-nuclei,, i.e., artifacts. A second database 285 contains the 
features calculated for objects that have been imaged by the system and that have been 
previously identified by an expert as cell nuclei. The data in each of these databases is 

35 fed into a statistical computer program which uses a stepwise linear discriminant 
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function analysis to derive a discriminant function that can distinguish cell nuclei from 
artifacts. The classifier is then constructed as a binary decision tree based on 
thresholds and/or the linear discriminant functions. The binary tree answers a series 
of questions based on the feature values to determine the identity of an object. 
5 The particular thresholds used in the binary tree are set by statisticians who 

compare histograms of feature values calculated on known objects. For example, 
white blood cells typically have an area less than 50|im 2 . Because the present 
invention treats a white blood cell as an artifact, the binary decision tree can contain a 
node that compares the area of an object to the 50jim 2 threshold. Objects with an 

10 area less than the threshold are ignored while those with an area having a greater area 
are further analyzed to determine if they are possible MAC cells or artifacts. 

In the presently preferred embodiment of the invention, the discriminant 
functions that separate types of objects are generated by the BMDP program available 
from BMDP Statistical Software, Inc., of Los Angeles, California. Given the 

15 discriminant functions and the appropriate thresholds, the construction of the binary 
tree classifier is considered routine for one of ordinary skill in the art. 

Once the binary tree classifier has been developed, it can be supplied with a set 
of feature values 292 taken from an unknown object and will provide an 
indication 294 of whether the object associated with the feature data is most likely an 

20 artifact or a cell nucleus. 

FIGURE 9 shows how a classifier is used to determine whether a slide exhibits 
malignancy-associated changes or not. The classifier 300 is constructed using a pair 
of databases. A first database 302 contains feature values obtained from apparently 
normal cells that have been imaged by the digital microscope system shown in 

25 FIGURE 1 and are known to have come from healthy patients. A second 
database 304 contains feature values calculated from apparently normal cells that 
were imaged by the digital microscope system described above and were known to 
have come from abnormal (i.e., cancer) patients. Again, classifier 300 used in the 
presently preferred embodiment of the invention is a binary decision tree made up of 

30 discriminant functions and/or thresholds that can separate the two groups of cells. 
Once the classifier has been constructed, the classifier is fed with the feature 
values 306 that are obtained by imaging cells obtained from a patient whose condition 
is unknown. The classifier provides a determination 308 of whether the nuclei exhibit 
MACs or not. 
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FIGURE 10 is a flow chart of the steps performed by the present invention to 
determine whether a patient potentially has cancer. Beginning at a step 325, the 
computer system recalls the features calculated for each in-focus nuclei on the slide. 
At a step 330, the computer system runs the classifier that identifies MACs based on 
5 these features. At a step 332, the computer system provides an indication of whether 
the nucleus in question is MAC-positive or not. If the answer to step 332 is yes, then 
an accumulator that totals the number of MAC-positive nuclei for the slide is 
increased at a step 334. At a step 336, the computer system determines whether all 
the nuclei for which features have been calculated have been analyzed. If not, the 

10 next set of features is recalled at step 338 and the process repeats itself. At a 
step 340, the computer system determines whether the frequency of MAC-positive 
cells on the slide exceeds a predetermined threshold. For example, in a particular 
preparation of cells (air dried, as is the practice in British Columbia, Canada) to detect 
cervical cancer, it has been determined that if the total number of MAC-positive 

15 epithelial cells divided by the total number of epithelial cells analyzed exceeds 0.45 per 
slide, then there is an 85% chance that the patient has or will develop cancer. If the 
frequency of cells exhibiting MACs exceeds the threshold, the computer system can 
indicate that the patient is healthy at step 342 or likely has or will develop cancer at 



20 The threshold above which it is likely that a patient exhibiting MACs has or 

will develop cancer is determined by comparing the MAC scores of a large numbers 
of patients who did develop cancer and those who did not. As will be appreciated by 
those skilled in the art, the particular threshold used will depend on the type of cancer 
to be detected, the equipment used to image the cells, etc. 

25 The MAC detection system of the present invention can also be used to 

determine the efficacy of cancer treatment. For example, patients who have had a 
portion of a lung removed as a treatment for lung cancer can be asked to provide a 
sample of apparently normal cells taken from the remaining lung tissue. If a strong 
MAC presence is detected, there is a high probability that the cancer will return. 

30 Conversely, the inventors have found that the number of MAC cells decreases when a 
cancer treatment is effective. 

As described above, the ability of the present invention to detect malignancy- 
associated changes depends on the values of the features computed. The following is 
a list of the features that is currently calculated for each in-focus object. 
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1.2 Coordinate Systems, Jargon and Notation 

Each image is a rectangular array of square pixels that contains within it the 
image of an (irregularly shaped) object, surrounded by background. Each pixel P y is 
an integer representing the photometric value (gray scale) of a corresponding small 
5 segment of the image, and may range from 0 (completely opaque) to 255 (completely 
transparent). The image rectangle is larger than the smallest rectangle that can 
completely contain the object by at least two rows, top and bottom, and two columns 
left and right, ensuring that background exists all around the object. The rectangular 
image is a matrix of pixels, P ij 3 spanning i = 1, L columns and j~\,M rows and with 
10 the upper left-hand pixel as the coordinate system origin, i=j=l. 

The region of the image that is the object is denoted by its characteristic 
function, O; this is also sometimes called the "object mask" or, simply, the "mask." 
For some features, it makes sense to dilate the object mask by one pixel all around the 
object; this mask is denoted fi + Similarly, an eroded mask is denoted £T. The object 
1 5 mask is a binary function: 

" = (fil,lA,2.--.^y..^L^) 0) 

where 



*j = 



\\if (ij) g object 
<£ object 

and where "(ij) e object" means pixels at coordinates: (?, j) are part of the object, 
20 and "(IJ) g object" means pixels at coordinates: (ij) are not part of the object. 



II Morphological Features 

Morphological features estimate the image area, shape, and boundary 
variations of the object. 

IL1 area 

25 The area, A, is defined as the total number of pixels belonging to the object, as 

defined by the mask, Q: 

area = A = £Z n /y ( 2 ) 
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where /, j and fl are defined in Section 1.2 above. 

IL2 x_centroid, y_centroid 

The x_centroid and y_centroid are the coordinates of the geometrical center of 
the object, defined with respect to the image origin (upper-left hand corner): 



L M 

x ceniroid = ^^ 



L M 

y__ centroid = 



(3) 



(4) 



A 

where i and j are the image pixel coordinates and Q is the object mask, as defined in 
Section 1.2 above, and A is the object area. 

11.3 mean_radius, maxradius 

10 The mean_radius and max_radius features are the mean and maximum values 

of the length of the object's radial vectors from the object centroid to its 8 connected 
edge pixels: 

N 

mean radius = r = — — (5^ 

max_ radius = max(r k ) (6) 
15 where r k is the A* radial vector, and N is the number of 8 connected pixels on the 
object edge. 

11.4 varj-adius 

The varjadius feature is the variance of length of the object's radius vectors, 
as defined in Section H.3. 



20 var radius = — 



N i 
Ur k -r) 2 



WO 99/08091 



PCT/CA98/00759 



-17- 



where r k is the to radius vector, f is the mean_radius, and N is the number of 8 
connected edge pixels. 

n.5 sphericity 

The sphericity feature is a shape measure, calculated as a ratio of the radii of 
5 two circles centered at the object centroid (defined in Section II.2 above). One circle 
is the largest circle that is fully inscribed inside the object perimeter, corresponding to 
the absolute minimum length of the object's radial vectors. The other circle is the 
minimum circle that completely circumscribes the object's perimeter, corresponding 
to the absolute maximum length of the object's radial vectors. The maximum 
10 sphericity value: 1 is given for a circular object: 

, . . min radius minfrv) 
sphericity ~ = = LJLL (8) 

max radius max(r k ) 

where r k is the radius vector. 

EL 6 eccentricity 

The eccentricity feature is a shape function calculated as the square root of the 
15 ratio of maximal and minimal eigenvalues of the second central moment matrix of the 
object's characteristic function, CI: 



eccentricity = / — — (9) 
2 

where Xi and \ 2 are ^ e maximal and minimal eigenvalues, respectively, and the 
characteristic function, £2, as given by Equation 1. The second central moment matrix 
20 is calculated as: 



[ ^momtntl ^ eroumomttdl ^ _ (10) 



✓ moment! 
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Eccentricity may be interpreted as the ratio of the major axis to minor axis of the "best 
fit" ellipse which describes the object, and gives the minimal value 1 for circles. 

5 II.7 inertiashape 

The inertia_shape feature is a measure of the "roundness" of an object 
calculated as the moment of inertia of the object mask, normalized by the area 
squared, to give the minimal value 1 for circles: 

2*Z Z Rf.Pi.j 

inertia _ shape = — '~ l J~ l ^ j j j 

A 

10 where Rjj is the distance of the pixel, Pjj, to the object centroid (defined in 
Section II.2), and A is the object area, and Q is the mask defined by Equation 1. 

II.8 compactness 

The compactness feature is another measure of the object's "roundness." It is 
calculated as the perimeter squared divided by the object area, giving the minimal 
15 value 1 for circles: 

p 2 

compactness = (12) 

AkA 
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where P is the object perimeter and A is the object area. Perimeter is calculated from 
boundary pixels (which are themselves 8 connected) by considering their 4 connected 
neighborhood: 

P = N t + J2N 2 + IN, (13) 
5 where Nj is the number of pixels on the edge with 1 non-object neighbor, N2 is the 
number of pixels on the edge with 2 non-object neighbors, and N3 is the number of 
pixels on the edge with 3 non-object neighbors. 



IL9 celI_orient 

The ce!l_orient feature represents the object orientation measured as a 
10 deflection of the main axis of the object from the y direction: 

(14) 

where y mom en n and *)> cruvmommti are the second central moments of the characteristic 
function Q defined by Equation 1 above , and X\ is the maximal eigenvalue of the 
second central moment matrix of that function (see Section II. 6 above). The main axis 

15 of the object is defined by the eigenvector corresponding to the maximal eigenvalue. 
A geometrical interpretation of the celI_orient is that it is the angle (measured in a 
clockwise sense) between they axis and the "best fit" ellipse major axis. 

For slides of cell suspensions, this feature should be meaningless, as there 
should not be any a priori preferred cellular orientation. For histological sections, and 

20 possibly smears, this feature may have value. In smears, for example, debris may be 
preferentially elongated along the slide long axis. . 

n.10 elongation 

Features in Sections 11.10 to 11.13 are calculated by sweeping the radius vector 
(from the object centroid, as defined in Section II.2, to object perimeter) through 128 
25 discrete equal steps (i.e., an angle of 2tc/128 per step), starting at the top left-most 
object edge pixel, and sweeping in a clockwise direction. The function is interpolated 
from an average of the object edge pixel locations at each of the 128 angles. 

The elongation feature is another measure of the extent of the object along the 
principal direction (corresponding to the major axis) versus the direction normal to it. 



lt 180 * 

cell orient = — + arctan 

n I 2 



(^1 y moment 2 ) 
Across momentj 
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These lengths are estimated using Fourier Transform coefficients of the radial function 
of the object: 



a 0 + 2 

elongation^ 



*0-2^ 



2 * 2 
a + ft 

2 2 

— 05) 

where a 2 ,i 2 are Fourier Transform coefficients of the radial function of the object, 
5 r(9), defined by: 

r W> = ^ + IX co<*0) + f>„ sSn(» ff) (16) 



11.11 freqjowjft 

The freqjowjft gives an estimate of coarse boundary variation, measured as 
the energy of the lower harmonics of the Fourier spectrum of the object's radial 
10 function (from 3rd to 1 1th harmonics): 

Jreq_low_ffi = +b* ) (17) 

where a nl b n are Fourier Transform coefficients of the radial function, defined in 
Equation 16. 

EL12 freOighJTt 

15 The freqjiighjft gives an estimate of the fine boundary variation, measured 

as the energy of the high frequency Fourier spectrum (from 12th to 32nd harmonics) 
of the object's radial function: 

32 f 2 i\ 

freq_high_ffi=2 \ a +h O 8 ) 
n=n\ n n) 

where a n ,b n are Fourier Transform coefficients of the m harmonic, defined by 
20 Equation 16. 
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IL13 harmonOlJTt, harmon32_fft 

The harmon01_fft, ... harmon32_fft features are estimates of boundary 
variation, calculated as the magnitude of the Fourier Transform coefficients of the 
object radial function for each harmonic 1 - 32: 



5 harmonn fft -Ja +i (19) 

~ y n n v ' 

where a ni b n are Fourier Transform coefficients of the n th harmonic, defined by 
Equation 16. 

Ill Photometric Features 

Photometric features give estimations of absolute intensity and optical density 
10 levels of the object, as well as their distribution characteristics. 

m.1 DNA_Amount 

DNA_Amount is the "raw" (unnormalized) measure of the integrated optical 
density of the object, defined by a once dilated mask, Q + : 

L M 

DNA_ Amount = £ £ OD u Qf s (20) 

15 where the once dilated mask, fl + is defined in Section 1.2 and OD is the optical 
density, calculated according to [12]: 

OD itj = log l0 1 % - logyo h.j (21) 

where I B is the intensity of the local background, and I fJ is the intensity of the ij th 
pixel. 

20 m.2 DNAJndex 

DNAJmdex is the normalized measure of the integrated optical density of the 



object: 



r\\TA t j DNA Amount 

DNA_ Index ^= (22) 



where iod norm is the mean value of the DNA amount for a particular object population 
25 from the slide (e.g., leukocytes). 
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m.3 var_intensity, mean_intensity 

The var_intensity and mean_intensity features are the variance and mean of the 
intensity function of the object, /, defined by the mask, Q: 

ZZdijClij-I) 2 
var_ intensity = — _ — _ ^23) 

5 where A is the object area, Q. is the object mask defined in Equation 1, and/ is given 
by: 

L M 

I E h.Pi.j 

UtltL A ; ™ 

I is the "raw" (unnormalized) mean intensity. 

mean intensity is normalized against iod norm defined in Section III.2: 

10 mean intensity = 7 ( ' Q ^°"n) (25) 

IQ.4 ODmaximum 

OD_jnaximum is the largest value of the optical density of the object, 
normalized to iod Hom7 as defined in Section III.2 above: 



OD_ maximum = maxCOD,- , ) (26) 



15 m.5 OD_variance 

OD variance is the normalized variance (second moment) of optical density 
function of the object: 

OD_ variance = — (27) 

(A-\)OD 2 

where Q is the object mask as defined in Section 1.2, OD is the mean value of the 
20 optical density of the object: 



WO 99/08091 



PCT/CA98/00759 



0£> = 



-23- 



( L M 

Z Z ODi p i tj 



A 



and A is the object area (total number of pixels). The variance is divided by the 
square of the mean optical density in order to make the measurement independent of 
the staining intensity of the cell. 

HI. 6 OD_s kew n ess 

The ODskewness feature is the normalized third moment of the optical 
density function of the object: 



OD skewness = - 



/=!/=! 



(28) 



(A -I) 



L M 

•LHODijCltj-OD? 



where £1 is the object mask as defined in Section 1.2, OD is the mean value of the 
optical density of the object and A is the object area (total number of pixels). 



m.7 OD_kurtosis 

OD_kurtosis is the normalized fourth moment of the optical density function 
of the object: 



OD kurtosis-^ 



ZXfODijQij-OD/ 
/=!/=! 



L M . 

SZ (ODij^j-OD) 7 
V/=ly=i 



(29) 



where O is the object mask as defined in Section 1.2, OD is the mean value of the 
optical density of the object and A is the object area. 
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IV Discrete Texture Features 

The discrete texture features are based on segmentation of the object into 
regions of low, medium and high optical density. This segmentation of the object into 
low, medium and high density regions is based on two thresholds: optical density high 
5 threshold and optical density medium threshold. These thresholds are scaled to the 
sample's iodnorm value, based on the DNA amount of a particular subset of objects 
(e.g., lymphocytes), as described in Section UI.2 above. 

By default, these thresholds have been selected such that the condensed 
chromatin in leukocytes is high optical density material The second threshold is 
10 located halfway between the high threshold and zero. 

The default settings from which these thresholds are calculated are stored in 
the computer as: i* 

CHROMATIN_HIGH_THRES = 36 
CHROMATIN JvffiDIUMJTHRES = 18 

15 A w g h is the area of the pixels having an optical density between 0 and 18, 

A med - is the area of the pixels having an optical density betweenT8 and 36 and A low 
is the area of the pixels having an optical density greater than 36. Together the areas 
Ahigh &mcd anc j A low sum to ^ total of the ob j ect The actual t hr es h 0 lds used 
are these parameters, divided by 100, and multiplied by the factor iod norm /\00. 

20 In the following discussion, H low , n med , and H hieh are masks for low-, 

medium-, and high-optical density regions of the object, respectively, defined in 
analogy to Equation 1. 

IV.l lowDNAarea, medDNAarea, hiDNAarea 

These discrete texture features represent the ratio of the area of low, medium, 
25 and high optical density regions of the object to the total object area: 

L M , 

z z n 7 , 

J A hw 

lowDNAarea = = (30) 

«=i/=i 
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L M . 

medDNAarea = ^± = (3 1) 

z z n,j 

i=l 7 =l 
1 M hi 

z z nft w 

hiDNAarea = i^ = — (32) 

z z n f j 

/-V-l 

where fi is the object mask as defined in Equation 1, and A is the object area. 



IV.2 lowDNAamnt, medDNAamnt, hiDNAamnt 

1 

These discrete texture features represent the total extinction ratio for low, 
medium, and high optical density regions of the object, calculated as the value of the 
integrated optical density of the low-, medium-, and high-density regions, 
respectively, divided by the total integrated optical density: 

L M . 

£ z OD u nft 

lowDNAamnt = (33) 

L M 

z z OD u a,j 

i=i;=l 

Z Z ODjjCl?? 

medDNAamnt = -^H (34) 

S Z OD u a,j 

i=lj=\ 

L M .. 

2 z oa jn& 

hiDNAamnt = (35) 

2 Z ODijQij 
J=ly=l 

where £2 is the object mask as defined in Equation 1, and OD is the optical density as 
defined by Equation 21. 
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IV.3 lowDNAcomp, medDNAcomp, hiDNAcomp, mhDNAcomp 

These discrete texture features are characteristic of the compactness of low-, 
medium-, high-, and combined medium- and high-density regions, respectively, 
treated as single (possibly disconnected) objects. They are calculated as the perimeter 
squared of each region, divided by An (area) of the region. 

/plow %2 

lowDNAcomp = ^ (36) 

rpmed x2 

medDNAcomp = } — (37) 

AnA med K } 

iphUl 

hiDNAcomp = } — (3 8) 

An A hi } 

mhDNAcomp = &±±fhif (39) 
4n(A med + A hi ) 

where P is the perimeter of each of the optical density regions, defined in analogy to 
Equation 13, and A is the region area, defined in analogy to Equation 2.. 

IV.4 low_av_dst, med_av_dst, hi_av_dst, mhavdst 

These discrete texture features represent the average separation between the 
low-, medium-, high-, and combined medium- and high-density pixels from the center 
of the object, normalized by the object mean radius. 

L M . 

low_ av_ dst = '-V- 1 (40) 

A mean jradius 

med_ av_ dst = — —r— (41) 

A me -mean radius 
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hi av dst 



L M . 



(42) 



L M . L M . . 



(43) 



where is defined in Section IL7 as the distance from pixel P u to the object 

centroid (defined in Section II.2), and the object meanjadius is defined by Equation 
5 5. 



10 



IV.5 lowVSmed_DNA, lowVShigh_DNA, IowVSmh_DNA 

These discrete texture features represent the average extinction ratios of the 
low- density regions, normalized by the medium-, high-, and combined medium- and 
high-average extinction values, respectively. They are calculated as the mean optical 
density of the medium-, high-, and combined medium- and high-density clusters 
divided by the mean optical density of the low density clusters. 



lowVSmed DNA = 



f L M A ( L M 

z z on it jCi?f 



Anted 



z z OD ltJ afj 
<=i/=i 



j low 



(44) 



lowVShi DNA = 



( L M . , ^ 

Z Z ODudlj 
/=iy=i 



' l m . <\ 
z Z OD,jnjff 



• lOW 



(45) 



lowVSmh DNA = 



( L M . L M .A ( L M 
Z Z OD,jClTf + Z Z ODijOJlj 
/=iy=i /=i/=i 



A med +A hi 



Z Z oD (J a\°j 



i low 



(46) 



15 where OD is the region optical density defined in analogy to Equation 21, Q is the 
region mask, defined in analogy to Equation 1, and A is the region area, defined in 
analogy to Equation 2. 
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IV. 6 low_den_obj, med_den_obj, high_den_obj 

These discrete texture features are the numbers of discrete 8-connected 
subcomponents of the objects consisting of more than one pixel of low, medium, and 
high density. 



5 IV.7 Iow_cntr_mass, med cntr_mass, high_cntr_mass 

These discrete texture features represent the separation between the geometric 
center of the low, medium, and high optical density clusters (treated as if they were 
single objects) and the geometric center of the whole object, normalized by its 
mean radius. 



10 



low cntr mass = 



/ L M 



- - x centroid 



\ 2 f L M V 

M Jml ^ y^centroid 



-r (mean_radius) 



(47) 



med cntr mass = 



f L M 

lalJ ' 1 . x centroid 



\ 2 f i M 

ZEROS' 

■= y centroid 

A~ d 



J 



+ (mean_radius) 
(48) 



hi cntr mass = 



f i u 

*" — x centroid 



A* 



\ 2 r l u 

— y " 1 y_centroid 



J 



(mean radius) 



15 (49) 
where mean_radius of the object is defined by Equation 5, the object's centroid is 
defined in Section IL2, H is the region mask defined in analogy to Equation 1, and A 
is the region area defined in analogy to Equation 2. 
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V Markovian Texture Features 

Markovian texture features are defined from the co-occurrence matrix, of 

object pixels. Each element of that matrix stands for the conditional probability of the 
pixel of grey level X occurring next (via 8-connectedness) to a pixel of grey level \i, 
5 where A,, \i are row and column indices of the matrix, respectively. However, the 
computational algorithms used here for the calculation of Markovian texture features 
uses so-called sum and difference histograms: H* and H d m \ where Hf is the 
probability of neighboring pixels having grey levels which sum to 1, and H d m is the 
probability of neighboring pixels having grey level differences of m, where an 8- 
10 connected neighborhood is assumed. Values of grey levels, 1, m, used in the sum and 
difference histogram are obtained by quantization of the dynamic range of each 
individual object into 40 levels. • 

For completeness, the formulae that follow for Markovian texture features 
include both the conventional formulae and the computational formulae actually used. 

15 V.l entropy 

The entropy feature represents a measure of "disorder" in object grey level 
organization: large values correspond to very disorganized distributions, such as a 
"salt and pepper" random field: 



V.2 energy 

The energy feature gives large values for an object with a spatially organized 
grey scale distribution. It is the opposite of entropy, giving large values to an object 
with large regions of constant grey level: 



entropy = £ £ A x tM . /ogio A x tfX ( conventional ) 



20 



entropy = H; Iog 10 H\ -£ H* m log l0 R* m {computational) (50) 



/ m 



25 



energy = Z S A , {conventional) 



energy = £ {Hf) + £ {H* ) 2 {computational) 



(51) 



/ m 
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V.3 contrast 

The contrast feature gives large values for an object with frequent large grey 
scale variations: 



contrast = ZE(X-u.) 2 A Xu (conventional) 

contrast = Xm 2 /z^j (computational) (52) 



V.4 correlation 

A large value for correlation indicates an object with large connected 
subcomponents of constant grey level and with large grey level differences between 
adjacent components: 

correlation = £ £ (X - I q )(\i -I q ) A x u (conventional) 

correlation = - £ (/ - 2I q )Hf -Zm 2 ^ (computational) (53) 

_ X m 

where I q is the mean intensity of the object calculated for the grey scale quantized to 

40 levels. 

V.5 homogeneity 

The homogeneity feature is large for objects with slight and spatially smooth 
grey level variations: 

homogeneity = Z E A \ u (conventional) 

Xul + (),-H) 2 

homogeneity = V — -H* (computational) (54) 
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V.6 clshade 

The cl_shade feature gives large absolute values for objects with a few distinct 
clumps of uniform intensity having large contrast with the rest of the object. Negative 
values correspond to dark clumps against a light background while positive values 
5 indicate light clumps against a dark background: 



cl_ shade = £ £ (X + |i - 2I q ) 3 A x ^ {conventional) 



cl shade = 



(computational) 



(55) 




V.7 



cI_prominence 

The feature cl_prominence measures the darkness of clusters. 

cl_ prominence =ZZ(^ + H-2/ ? ) 4 i Xi(l {conventional) 



10 



E(/-2/^) 4 /// 



cl_ prominence = 



(computational) 



(56) 
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VI Non-Markovian Texture Features 

These features describe texture in terms of global estimation of grey level 
differences of the object. 

VL1 den_lit_spot, den_drk_spot 

5 These are the numbers of local maxima and local minima, respectively, of the 

object intensity function based on the image averaged by a 3 x 3 window, and divided 
by the object area. 

i f 5™* 

den Jit_ spot = ' ~ 1/=I : (57) 

A ■ 

and 

L M . 

Z« c nun 
S 6..., 

i'=i i'=i ,J 

10 den_drk_spot = ^-^ (58) 

where 

g max P *f there exists a local maximum of I' V y with value max ^j* 
' •j' \0 otherwise 



and 



c min 



15 and where 



1 if there exists a local minimum of y with value min^jt 
0 otherwise 



2 r+i y+i 
f'rj' = qZ Yj^ij^U 



and / is the object intensity, fl is the object mask, and A is the object area. 
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VL2 range_extreme 

This is the intensity difference between the largest local maximum and the 
smallest local minimum of the object intensity function, normalized against the slide 
DNA amount, iodnorm , defined in Section III. 2. The local maxima, max,, ; , and 
minima, min rj , , are those in Section VI. 1 above. 

range_ extreme = {maxQnax^ j ) - (minQninjj )) I — ] (59) 

\ iod norm J 



10 



VL3 range__average 

This is the intensity difference between the average intensity of the local 

maxima and the average intensity of the local minima, normalized against the slide 

DNA amount value, iodnorm, defined in Section III.2 above. The local maxima, 
max,. r and minima, min,^., , values used are those from Section VI. 1 above. 



range_ average = 



( L M L M 

Z Z maxjt j, £ 2 min v 



L M 



Z Z 5T? 



L M 

Z Z 5™ 



100 



iod. 



norm 



(60) 



VL4 center_of_gravity 

The centerj)f_gravity feature represents the distance from the geometrical 
15 center of the object to the "center of mass" of the optical density function, normalized 
by the mean_radius of the object: 



center^ of_ gravity = 



f L M 

ZW-ODijCltj 

L M 

Z Z ODijCIij 
\ /-V-i 



\ 2 ( L M 

ZZj-ODijiltj 



-x centroid 



J 



L M 



■ y ceniroid 



mean radius 



(61) 



This gives a measure of the nonuniformity of the OD distribution. 
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VII Fractal Texture Features 

The fractal texture features are based on the area of the three-dimensional 
surface of the object's optical density represented essentially as a three-dimensional 
bar graph, with the vertical axis representing optical density, and the horizontal axes 
5 representing the x andy spatial coordinates. Thus, each pixel is assigned a unit area in 
the x - y plane plus the area of the sides of the three-dimensional structure 
proportional to the change in the pixel optical density with respect to its neighbors. 
The largest values of fractal areas correspond to large objects containing small 
subcomponents with high optical density variations between them. 
10 The difference between fractal l_area and fracta!2_area is that these features 

are calculated on different scales: the second one is based on an image in which four 
pixels are averaged into a single pixel, thereby representing a change of sc?ile of 
fractal larea. This calculation needs the additional mask transformation: 
&i2J2 represents the original mask H with 4 pixels mapped into one pixel and any 

15 square of 4 pixels not completely consisting of object pixels is set to zero. QjJ 
represents Cl i2J2 expanded by 4 so that each pixel in n a j2 is 4 pixels in Qi,j . 



VEL1 fractall_area 

fractal 1_ area = £ jf (|aD* y - OD* tj ^\(DD*j - 0D/-ij|+l)n,j (62) 

where OD] %s is the optical density function of the image scaled by a factor common to 
20 all images such that the possible optical density values span 256 levels. 

VIL2 fractal2_area 

This is another fractal dimension, but based on an image in which four pixel 
squares are averaged into single pixels, thereby representing a change of scale of 
fractal 1 area in Section VII. 1 above. 



25 fractal area = £ Z<\OD» J2 - <K**W D h* ' 0D Uj\ + ^w, ( 63 ) 

where, L 2 ^"^j 1 ^ 2 = [^r]' W ^ ^ ^2 as integers, and OD* 2 J2 is a scaled 
optical density function of the image, with 4 pixels averaged into one. 
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V1I.3 fractaldimen 

The fractal_dimen feature is calculated as the difference between logarithms of 
fractal l_area and fracta!2_area, divided by log 2. This varies from 2 to 3 and gives a 
measure of the "fractal behavior" of the image, associated with a rate at which 
measured surface area increases at finer and finer scales. 

fractal. dimen = ^SloO^L^) - ^{fractal! _area) 

login 2 

VIII Run Length Texture Features 

Run length features describe texture in terms of grey level runs, representing 
sets of consecutive, collinear pixels having the same grey level value. The length of 
the run is the number of pixels in the run. These features are calculated over the image 
with intensity function values transformed into 8 levels. 

The run length texture features are defined using grey level length matrices, 
3l®3 for each of the four principal directions: 6 = 0°, 45°, 90°, 135°, where the 

directions are defined clockwise with respect to the positive x-axis. Note: As defined 
here, the run length texture features are not rotationally invariant, and therefore 
cannot, in general, be used separately since for most samples there will be no a priori 
preferred direction for texture. For example, for one cell, a run length feature may be 
oriented at 45°, but at 90° in the next; in general, these are completely equivalent. 
Each element of matrix 91® g specifies the number of times that the object contains a 

run of length q, in a given direction, 0, consisting of pixels lying in grey level range, p 
(out of 8 grey levels). Let N s = 8 be the number of grey levels, and N r be the number 
of different run lengths that occur in the object; then the run length features are 
described as follows: 
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Vm.1 shortO_runs, short45jruns, short90_runs, shortl35_runs 

These give large values for objects in which short runs, oriented at 0°, 45°, 
90°, or 135°, dominate. 

shortB runs = £±2^ q (65) 
N g N r ~ 

z Z *% q 

p=lq=l 

5 Vm.2 long0_runs, !ong45_runs, long90_runs, longi35_runs 

These give large values for objects in which long runs, oriented at 0°, 45°, 90°, 
or 135°, dominate. 

Z Z q % *% 

longG runs= p=lq " 1 (66) 

z z n% 

Vm.3 greyOJevel, grey45_level, grey90Jevel, greyl35Jeve! 

10 These features estimate grey level nonuniformity, taking on their lowest values 

when runs are equally distributed throughout the grey levels. 

. i 2 



N g 

Z 



Z 



greyQ M = f±^l '— (67) 

z i z *% 
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Vm.4 mnOJength, run45_length, run90Jength, runl35Jcngth 

These features estimate the nonuniformity of the run lengths, taking on their 
lowest values when the runs are equally distributed throughout the lengths. 

\ 2 



N r 



run 8_ length = 



2- Ji p,q 



N* N r 



(68) 



,0 



p=lq=l 



5 VIII.5 rimO_percent, run45_percent, run90_percent, runl35_percent 

These features are calculated as the ratio of the total number of possible runs 
to the object's area, having its lowest value for pictures with the most linear structure. 



run 6_ percent = - iq 1 



N* N r Q 



(69) 



where A is the object's area. 



10 Vm.6 texture_orient 

This feature estimates the dominant orientation of the object's linear texture. 



180 t: 

texture orient = — + arctan 

% 2 



1 "* y pseudo-moment 2 ) 
*y pseudo-cross jnoment 2 
where X[ is the maximal eigenvalue of the run length pseudo-second moment matrix 
(calculated in analogy to Section II.9). The run length pseudo-second moments are 
1 5 calculated as follows: 



(70) 



Xpxcudo - moment2 = ^ | ^ | 
p=\ 9=1 

y pseudo - moment! — ^ ^ 



1=1 J 

1=1 J 



(71) 



(72) 
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xypseudo - cross _moment2 = 




1=1 



N* N r 



J y 



2V2 



(73) 



Orientation is defined as it is for celLorient, Section II.9, as the angle 
(measured in a clockwise sense) between the y axis and the dominant orientation of 
the image's linear structure. 



VIIL7 size_txt_orient 

This feature amplifies the texture orientation for long runs. 

A' 

size_ txt_ orient = —J- (74) 

where X\,k\ are the maximal and minimal eigenvalues of the runjength pseudo- 

10 second moment matrix, defined in Section VIII.6. 

Each of the above features are calculated for each in-focus object located in 
the image. Certain features are used by the classifier to separate artifacts from cell 
nuclei and to distinguish cells exhibiting MACs from normal cells. As indicated 
above, it is not possible to predict which features will be used to distinguish artifacts 

15 from cells or MAC cells from non-MAC cells, until the classifier has been completely 
trained and produces a binary decision tree or linear discriminant function. 

In the present embodiment of the invention, it has been determined that 
thirty (30) of the above-described features appear more significant in separating 
artifacts from genuine nuclei and identifying cells with MACs. These primarily 

20 texture features are as follows: 
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10 



1) Area 

2) mean radius 

3) OD variance 

4) OD skewness 

5) range average 

6) OD maximum 

7) density of light spots 

8) low DNA area 

9) high DNA area 

10) low DNA amount 



30 preferred nuclear features 

11) high DNA amount 

12) high average distance 

13) mid/high average distance 

14) correlation 

15) homogeneity 

16) entropy 

17) fractal dimension 

18) DNA index 

19) run 0 percent 

20) run 45 percent 



2 1) run 90 percent 

22) run 135 percent 

23) grey level 0 

24) grey level 45 

25) grey level 90 
25) grey level 135 

27) run length 0 

28) run length 45 

29) run length 90 

30) run length 135 



Although these features have been found to have the best ability to 
differentiate between types of cells, other object types may be differentiated by the 
other features described above. 

As indicated above, the ability of the system according to the present invention 
to distinguish cell nuclei from artifacts or cells that exhibit MACs from those that do 
not depends on the ability of the classifier to make distinctions based on the values of 
the features computed. For example, to separate cell nuclei from artifacts, the present 
invention may apply several different discriminant functions each of which is trained 
to identify particular types of objects. For example, the following discriminant 
function has been used irilhe presently preferred embodiment of the invention to 
separate intermediate cervical cells from small picnotic objects: 





cervical cells 


picnotic 


maxradius 


4.56914 


3.92899 


freq_low_fft 


-.03624 


-.04714 


harmon03_fft 


1.29958 


1.80412 


harmon04.fft 


.85959 


1.20653 


lowVSmedJDNA 


58.83394 


61.84034 


energy 


6566.14355 


6182.17139 


correlation 


.56801 


.52911 


homogeneity 


-920.05017 


-883.31567 


cl_shade 


-67.37746 


-63.68423 


den_drk_spot 


916.69360 


870.75739 
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CONSTANT -292.92908 -269.42419 

Another discriminant function that can separate cells from junk particles is: 





cells 


junk 


eccentricity 


606.67365 


574.82507 


compactness 


988.57196 


1013.19745 


freq__low_fft 


-2.57094 


-2.51594 


freq_high__fft 


-28.93165 


-28.48727 


harmon02.flEt 


-31.30210 


-30.18383 


harmon03.ffl 


14.40738 


14.30784 


medDNAamnt 


39.28350 


37.50647 


correlation 


.27381 


.29397 


CONSTANT 


-834.57800 


-836.19659 


Yet a third discriminant function that can separate folded cells that 



ignored from suitable cells for analysis. 



normal interm 

709.66357 
456.09146 
1221.73840 
-391.76352 
-37.89624 
-41.89951 
1.40092 
.26310 
.06601 
-968.73628 

Obviously, the particular linear discriminant function produced by the classifier 
will depend on the type of classifier used and the training sets of cells. The above 
examples are given merely for purposes of illustration. 

As can be seen, the present invention is a system that automatically detects 
malignancy-associated changes in a cell sample. By properly staining and imaging a 
cell sample, the features of each object found on the slide can be determined and used 
to provide an indication whether the patient from which the cell sample was obtained 
is normal or abnormal. In addition, MACs provide an indication of whether cancer 
treatment given is effective as well as if a cancer is in remission. 



sphericity 

eccentricity 

compactness 

elongation 

freq_highjfft 

lowDNAamnt 

low_den_obj 

correlation 

range_average 

CONSTANT 



rejected objects 

701.85864 
444.18469 
1232.27441 
-387.19376 
-37.39510 
-39.42714 
1.60374 
.29536 
.06029 
-971.18219 
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In another aspect, the present invention provides a system and method for 
automatically detecting diagnostic cells and cells having malignancy-associated 
changes. The system is an image cytometer based automated cytological specimen 
classifier useful for classifying cells within a cytological specimen (i.e., cell sample). 
5 In addition to the components of the image cytometer, which include a microscope for 
obtaining a view of the cytological specimen, a camera for creating an image of the 
view of the cell sample, an image digitizer for producing a digital representation of the 
image of the cells, and computer system for recording and analyzing the digital image 
and for controlling and interfacing these components, the automated classifier further 

10 includes a primary classifier for preliminarily classifying a cytological specimen, and a 
secondary classifier for classifying those portions of a cytological specimen initially 
classified by the primary classifier. Generally, the image cytometer captures images of 
cells of interest from a slide. The images are automatically classified into various cell 
subtypes, such as normal and abnormal epithelial cells or inflammatory cells. The 

15 classification can be achieved by using various classification schemes including linear 
and nonlinear classification methods that incorporate, for example, neural networks, 
binary decisions based upon directly calculated nuclear features, decision trees, 
decision webs, and discriminant functions. Several types of classifications can be 
performed. 

20 In a preferred embodiment of the present invention, the primary classifier 

distinguishes and selects epithelial cells from among the cells of the cell sample, and 
the secondary classifier indicates whether the selected epithelial cells are normal (i.e., 
MAC negative) or have malignancy-associated changes (i.e., MAC positive). Thus, 
applying the principles generally described above, the first automated classifier screens 

25 a cell sample for epithelial cells, whether normal or diagnostic, and then the second 
classifier identifies the normal cells as normal and MAC-negative or normal and 
MAC-positive. The overall system of the present invention is schematically 
represented in FIGURE 11. It will be appreciated that although the system of the 
present invention includes a first (i.e., primary) and a second (i.e., secondary) 

30 classifier as depicted in FIGURE 1 1, the classifications obtained by the present system 
can be achieved by a single classifier that sequentially performs the primary and 
secondary classifications further described below. 

As used herein, the term "diagnostic cell" refers to a visually apparent 
cancerous (i.e., malignant) cell or a pre-cancerous (i.e., pre-malignant) cell. The term 

35 "cancerous ceU n refers to an invasive cancerous cell, and the term "pre-cancerous cell" 
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refers to a pre-invasive cancerous cell. Generally, only a fraction of pre-invasive 
cancerous cells mature to invasive cancerous cells. The term "malignancy-associated 
change" or "MAC" refers to subvisual or nearly subvisual changes to the chromatin 
arrangement of visually normal nuclei, the changes being correlated to the presence of 

5 a tumor in a patient. 

The system includes classifiers that can work together to determine whether a 
particular cell sample includes diagnostic cells and cells having malignancy-associated 
changes. As described above, a classifier is a computer program that analyzes an 
object based on certain feature values. The automated classifier system of the present 

10 invention includes a primary classifier, which performs a basic screening function, and 
selects normal epithelial cells. A secondary classifier classifies the epithelial cells as 
either normal and having malignancy-associated changes or normal and not exhibiting 
malignancy-associated changes. As noted above, while the automated system of the 
present invention preferably includes a primary and secondary classifier, a single 

15 classifier can be used to sequentially obtain the classifications achieved by the present 
invention. The software packages used to generate classification functions based on 
statistical methods are generally commercially available. Statistical classifiers useful in 
the present invention have been constructed as generally described above and shown 
in FIGURES 8 and 9. 

20 The automated classifier of this invention preferably includes classifiers that 

utilize binary decisions based on directly calculated nuclear features in performance of 
their classification function. While the classifier can be constructed to include a large 
number of feature values, including the morphological features, photometric features, 
discrete texture features, Markovian texture features, non-Markovian texture features, 

25 fractal texture features, and run length texture features, it has been determined that of 
the features described above, 33 appear more significant in identifying epithelial cells 
and identifying diagnostic cells and cells having malignancy-associated changes. 
These features include: 
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1) area 12) high average distance 

2) mean radius 13) mid/high average distance 

3) OD variance 14) correlation 

4) OD skewness 15) homogeneity 

5) range average 16) entropy 

6) OD maximum 17) fractal dimension 

7) density of light spots 1 8) DN A index 

8) low DNA area 19) run 0 percent 

9) high DNA area 20) run 45 percent 

10) low DNA amount 2 1) run 90 percent 

1 1) high DNA amount 22) run 135 percent 



23) grey level 0 

24) grey level 45 

25) grey level 90 
25) grey level 135 

27) run length 0 

28) run length 45 

29) run length 90 



30) run length 135 



31) harmonic 4 

32) harmonic 5 

33) harmonic 6 



Although these features have been determined to have the best ability to 
differentiate between types of cells, other object types may be differentiated by other 
features. 

The primary classifier functions to subtype cells into three classes: 
5 (1) epithelial cells including diagnostic cells and cells that may contain malignancy- 
associated changes; (2) inflammatory cells; and (3) junk. The primary classifier affects 
cell-by-cell classification through a binary decision tree incorporating a selection of 
feature values as shown in FIGURE 12. In a preferred embodiment, the primary 
classifier performs its classification function utilizing the 33 features noted above. 
10 As indicated above, the ability of the system of the present invention to 

distinguish cell nuclei from artifacts, epithelial cells from other cell types, and cells 
having malignancy-associated changes from other normal epithelial cells depends on 
the ability of the classifier to make distinctions based on the values of the features 
computed. For example, to distinguish normal epithelial cells from abnormal epithelial 
15 cells (i.e., diagnostic cells), the present invention may apply several different 
discriminant functions, each of which is trained to identify particular types of objects. 
For example, the following discriminant function has been used in one presently 
preferred embodiment of the invention to distinguish normal epithelial cells from 
abnormal cells: 



FEATURE 



Normal 



Cancer 



2 harmon05 

3 freqmac2 



199.62447 
34.19107 



223.06030 . 
50.18366 



CONSTANT 



-51.21967 



-65.70574 
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Although the above functions have been successful in distinguishing normal 
epithelial cells from abnormal cells, those skilled in the art will recognize that the 
exact weights used in the functions will depend on the type of classifier used and the 
training sets of cells. The above example is given merely for the purpose of 
5 illustration. 

The secondary classifier classifies the epithelial cells in the cell sample selected 
by the primary classifier and also uses a binary decision tree and feature values in 
performance of its classification function. The secondary classifier, which can be 
considered as a slide-by-slide classifier, analyzes the epithelial cells classified by the 

10 primary classifier and classifies those cells as normal and MAC-negative or normal 
and MAC-positive. The secondary classifier thus distinguishes normal epithelial cells 
having malignancy-associated changes (i.e., MAC positive) from normal epithelial 
cells that do not exhibit malignancy-associated changes (i.e., MAC negative). As with 
the primary classifier, the secondary classifier is constructed to distinguish cells based 

15 on a set of preferred nuclear features. In a preferred embodiment, the secondary 
classifier performs its classification function utilizing the following features: 

1) area 8) homogeneity 

2) density of light spots 9) entropy 

3) low DNA area 10) fractal dimension 

4) high DNA area 1 1) DNA index 

5) low DNA amount 12) OD maximum 

6) high DNA amount 13) medium DNA amount 

7) correlation 

The operation of the secondary classifier is schematically shown in 
FIGURE 13. 

The feature sets used by each classifier are developed from discriminant 
20 functions analyzing quantitative features of cell nuclei and, preferably, include a 
minimum number of features. Ideally, the selection of a minimum number of optimal 
nuclear features results in an efficient and robust classifier. That is, a classifier is 
preferably both efficient in accurately classifying a cell or a cell type, and robust in 
reliably classifying a variety of cell and slide preparations. 
25 The ability of the system of the present invention to distinguish cells having 

malignancy-associated changes from epithelial cells that do not exhibit such changes 
depends on the ability of the classifier to make distinctions based on the values of the 
features computed. To distinguish cells having malignancy-associated changes from 
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cells that do not, the present invention may apply several different discriminant 
functions, each of which is trained to identify particular types of objects. For 
example, the following discriminant function has been used in the presently preferred 
embodiment of the invention to distinguish cells having malignancy-associated 
changes from normal epithelial cells that do not exhibit malignancy-associated 
changes: 



FEATURE 

30 harmon03_fft 
93 cl_shade 
96 den_drk_spot 
105fractal2 area 



MAC-negative MAC-positive 

3.52279 3.82334 

0.99720 -1.09342 

168.27394 189.80289 

0.00372 0.00056 



CONSTANT -63.66887 -67.90617 

Although the above functions have been successful in distinguishing normal 
MAC-negative cells from normal MAC-negative cells, those skilled in the art will 
recognize that the exact weights used in the functions will depend on the type of 
10 classifier used and the training sets of cells. The above example is given merely for 
the purpose of illustration. 

The selection of features for construction of a classifier can often depend on 
the method of cell fixation and nuclear staining. Thus, the selection of a feature set 
for a particular cell preparation will depend upon the method by which the cells were 
15 fixed and stained. While some feature sets are sufficiently robust to be useful in 
diagnosing a number of conditions, it has been found that malignancy-associated 
changes are quite sensitive to fixation method. For example, formalin fixation, a 
commonly used fixation for tissue preparations, provides fixed cells that are not 
efficiently classified by the preferred embodiment of the automated classifier system of 
20 the present invention. However, using the principles of the present invention, a 
classifier could be constructed to efficiently and robustly classify such fixed cells. In 
the practice of the present invention, Saccamanno fixation and its variants, and Bohm- 
Sprenger fixation and its variants are preferred methods of fixation. 

After a cell sample is fixed, the sample is then stained with a nuclear stain to 
25 identify ceil nuclei within the sample. Preferably, the cellular DNA staining is a 
quantitative and stoichiometric staining of the DNA. Preferred stoichiometric DNA 
stains include Feulgen stains, such as thionine and para-rosanaline; Rousmouski stains, 
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such as Wright stain, May-Grunwald-Geimsa stain, and Hematoxylin; and Methyl 
Green. In a preferred embodiment, the Feulgen stain is thionin. Other stains 
including qualitative stains, such as Hematoxylin and Eosin, can also be used. 
Representative fixation and staining procedures are described in Example 1 below. 
5 The automated classifier of the system and method of the present invention are 

used for classifying cells obtained from a cytological specimen. In general, the system 
and method of the present invention are useful for classifying a wide variety of 
cytological specimens. For example, the present invention is useful in the 
classification of cytological specimens in the form of cervical smears in connection 

10 with a Pap test. Histological specimens including tissue sections, such as are 
generally taken from a tissue obtained during a tumor biopsy or during surgical 
removal of a tumor, may also be classified. The system and method of the p^sent 
invention are particularly well suited for the classification of bronchial specimens. As 
used herein, the term "bronchial specimen" refers to both tissue acquired during 

15 bronchoscopy or surgery, and to cytological specimens that originated in whole or in 
part from the bronchial epithelium whether acquired by brushing, washing, or sputum 
cytology. The system and method of the present invention have been found to be 
effective in detecting diagnostic cells and cells having malignancy-associated changes 
in cell samples derived from lung sputum. A representative method for the collection 

20 of lung sputum is described in Example 2. 

The system and method of the present invention are particularly well-suited 
for the classification of epithelial cells and, consequently, useful in the diagnosis and 
monitoring of various epithelial cancers including lung cancer, breast cancer, prostate 
cancer, cancers of the gastrointestinal tract, and skin cancer, among others. 

25 The method for detecting epithelial cells in a cell sample generally includes the 

steps of: (1) obtaining a cell sample; (2) staining the sample to identify cell nuclei 
within the sample; (3) obtaining an image of the cell sample with a digital microscope 
having a digital CCD camera and a programmable slide stage such as described above; 
(4) focusing the image; (5) identifying objects in the image; (6) calculating a set of 

30 feature values for each object identified; and (7) analyzing the feature values to 
determine whether each object is an epithelial cell. As described above for the 
primary classifier, the step of analyzing the feature values to determine whether each 
object is an epithelial cell includes the use of a binary decision tree that considers the 
nuclear features noted above. 
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The method for detecting diagnostic cells and cells having malignancy- 
associated changes generally includes the same steps as described above for the 
method for detecting epithelial cells, however, the steps of calculating a set of feature 
values and analyzing the feature values rely on the secondary classifier as described 
5 above to determine whether each object is a normal epithelial cell having a 
malignancy-associated change or a normal epithelial cell that is not exhibiting a 
malignancy-associated change. As with the secondary classifier, the analyzing step 
includes the use of a binary decision tree that utilizes nuclear features to classify the 
cells. 

10 Both of the above-described methods are applicable to the analysis of a wide 

variety of cytological specimens including bronchial specimens such as lung sputum. 

The present invention also provides a method for detecting diagnostic cells 
and cells having malignancy-associated changes and further predicting whether a 
patient will develop cancer. Generally, the method detects pre-invasive cancerous 

15 cells and predicts whether the patient will develop invasive cancer. The method 
includes the steps of obtaining a sample of cells from the patient, determining whether 
the cells in the sample include either diagnostic cells or cells having malignancy- 
associated changes by first staining the nuclei of the cells in the sample to obtain an 
image of those ceils with a microscope and recording the image in a computer system; 

20 and secondly, analyzing the stored image of the cells to identify the nuclei, and then 
computing a set of feature values for each nucleus found in the sample and from those 
feature values determine whether the nucleus is the nucleus of a normal cell or a cell 
having a malignancy-associated change. After such a determination, the total number 
of cells having malignancy-associated changes is determined and from that number a 

25 predication of whether the patient will develop cancer can be made. The prediction is 
based upon threshold values for diagnostic cells and cells having malignancy- 
associated changes similar to the predictive method described above for MAC- 
positive cells. 

The following examples are provided for the purposes of illustration, and not 
30 limitation. 

EXAMPLES 
Example 1 

Representative Procedure for Cell Fixing and Cellular DNA Staining 

In this example, a representative procedure for fixing cells and staining 
35 cellular DNA with thionin is described. The reagents used in the DNA staining 
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procedure, including methanol and t-butanol solutions of thionin, and fixative and 
rinse solutions, are prepared as described below. 
Stain Reagent Preparations : 

A. Methanolic Feulgen Staining Solution 
5 THIONIN/METHANOL STAINING SOLUTION 

1. Add 0.5 g thionin (Aldrich Chemical Co., Milwaukee, WI) and 0.5 g sodium 
metabisulfite to a 500 ml glass bottle with a stirring bar. 

2. Add 200 ml methanol. Mix well. * 

3 . Add 250 ml distilled water. 

10 4. Add 50 ml IN hydrochloric acid and cap the bottle. 

5. Stir stain solution for one hour. Protect solution from light by wrapping the 
bottle with aluminum foil. Do not refrigerate. 

6. Filter stain solution through filter paper (No. 1 grade) in a fume hood 
immediately prior to use. 

15 

B. Conventional Feulgen Staining Solution 
TfflONIN/t-BUTANOL STAINING SOLUTION 

1. Add 0.5 g thionin to 435 ml distilled water in a 2000 ml Erlenmeyer flask. 

2. Heat solution to boiling for about 5 minutes and then allow to cool to about 
20 room temperature. 

3. Add 435 ml t-butanol. (If necessary, melt the t-butanol in a waterbath. The 
melting point of t-butanol is 25-26°C and therefore is a solid at temperatures 
below about 25°C). 

4. Add 130 ml IN aqueous hydrochloric acid. 
25 5. Add 8.7 g sodium metabisulfite. 

6. Add stirring bar and seal container with Parafilm M. 

7. Stir stain solution for at least 1 hour. Protect from light and do not 
refrigerate. 

8. Filter stain solution through filter paper ( No. 1 grade) in a fiime hood just 
30 prior to use. 

Other Reagent Preparations : 

BOHM-SPRENGER FIXATIVE 

L Combine 320 ml methanol and 60 ml aqueous formaldehyde (37%) in a 500 
35 ml glass bottle. 



WO.99/08091 



PCT/CA98/00759 



-49- 



2. Add 20 ml glacial acetic acid. 

3 . Mix well and seal with Parafilm M. 



RINSE SOLUTION 

5 1. Dissolve 7.5 g sodium metabisulfite in 1425 ml distilled water in a 2000 ml 
Erlenmeyer flask. 

2. Add 75 ml IN aqueous hydrochloric acid. 

3 . Add stirring bar and stir until dissolved. Seal flask with Parafilm M. 

10 1% ACID ALCOHOL 

1. Mix 280 ml of absolute ethanol and 120 ml distilled water. 

2. Add 4 ml concentrated hydrochloric acid. 

3. Mix well. 



15 The reagents prepared as described above were then used to fix cells and stain 

cellular DNA by the following method. Preparations of cells of interest (e.g., cells 
from uterine cervix samples or lung sputum samples), including conventional smears 
and monolayer preparations, may be used in the method. In the method, cells are 
generally deposited on a microscope slide for staining. 

20 Fixing and Staining Procedure: 

1. Deposit cells on a microscope slide. 

2. Fix cells by immersing slide in Bohm-Sprenger fixative: 30-60 minutes. 

3. Rinse slide in distilled water: 1 minute, agitate. 

4. Hydrolyze cellular DNA by immersing slide in 5N hydrochloric acid: 60 
25 minutes at room temperature. 

5. Rinse slides in distilled water: 15 dips, agitate. 

6. Stain cells by applying freshly filtered thionin stain solution: 75 minutes. 

7. Wash slides in distilled water: 6 changes, 20 dips each. 

8. Rinse slides in freshly prepared rinse solution: 3 changes: 

30 30 seconds for the first two rinses, 5 minutes for the last rinse. 

9. Rinse slides in distilled water: 3 changes, 20 dips each. 

10. For mucoidal samples only: 

Optionally rinse slides in 1% acid alcohol: 2 minutes. 

11. Rinse slides in distilled water: 3 changes, 20 dips each. 
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12. Dehydrate cells by sequentially immersing the slides in 50%, 75% aqueous 
ethanol and two changes of 100% ethanol: 1 minute each. 

13. Clear slides by immersing in xylene: 5 minutes. 

14. Mount coverslips on slides. 

5 15. Identify slides with barcode labels if desired. 

Example 2 

Representative Procedure for Collecting Lung Sputum 
In this example, a representative procedure for collecting lung sputum is 
described. Generally, lung sputum may be collected by either an induction or pooled 
10 method. 

Induction Method 

Sputum induction using sterile water or saline solution increases both the 
mobility and quantity of sputum available for examination. Preferably, the subject first 
clears his/her throat and rinses the mouth thoroughly, and possibly brushes the teeth 
15 to reduce background debris that might influence the results. The subject then 
performs the three deep-breath/three deep-cough technique as described below: 

1. A nebulizer with disposal mouthpiece is placed in the subject's mouth. 

2. A disposable nose clip is applied to the subject's nose. 

3 . A timer is set for one minute. 

20 4. The subject inhales and exhales the nebulizer mist through the mouth for one 

minute breathing normally. 
5. The subject performs the first deep breath by inhaling the maximum inspiratory 

breath of mist through the mouthpiece, holding for five seconds, and forcefully 

exhaling into a tissue paper. 
25 6. The subject performs the second deep breath by repeating step 5. 

7. The subject performs the third deep breath by inhaling the maximum 
inspiratory breath of mist through the mouthpiece, holding for five seconds, 
covering the mouth with tissue, coughing deeply, and spitting sputum into the 
sputum collection jar containing 30 ml of fixative (prepared as described in 

30 Example 3). 

8. The subject repeats steps 3-7 five times. 
Three-Day Pooling Method 

In the three-day pooling method, the subject collects an early morning sputum 
sample on three or more subsequent mornings according to the three-day pooling 
35 method outlined below: 
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1. The subject clears his/her throat and rinses the mouth thoroughly, and possibly 
brushes the teeth to reduce background debris that might influence the results. 

2. The subject produces the sputum sample and spits it into the sample collection 
jar containing 30 ml of fixative (prepared as described in Example 3). 

5 3. The subject refrigerates the specimen collected in jar overnight. 
4. The subject repeats steps 1-3 for two or more subsequent mornings. 

Example 3 
Representative Fixation Solutions 
Fixation is one of the most critical steps in the image cytometry and 
10 classification of Feulgen stained cells. It has been determined that the fixative 
chemistry influences the staining results and, consequently, the cell classification. 
Several fixatives have been investigated for their suitability and an ethanol and 
polyethylene glycol mixture has been identified as a preferred fixative. 

The standard fixative, a 50% aqueous ethanolic solution that includes 1-2% 
15 polyethylene glycol by volume, is used in the sample collection jars to preserve and fix 
the sputum sample until cytology sample preparation. The standard fixative is 
prepared by adding 384 ml of fixative concentrate (SEDFIX, SurgiPath Company) to 
a four liter container followed by the addition of 1700 ml of distilled water and 
1700mlof95%ethanol. 
20 To prepare the preferred fixative, the standard fixative is modified by the 

addition of dithiothreitol (DTT). Independent studies indicate that DTT breaks up 
mucous and increases the yield of diagnostic cells without adversely affecting 
morphology when low concentrations are used. DTT has also been discovered to 
reduce the background staining of the specimens. The DTT fixative is used during 
25 sample preparation and provides a post-fixation method to break up mucous in the 
sputum sample. The DTT fixative solution is prepared by adding 0.4 grams DTT to 
four liters of the standard fixative prepared as described above. 

Example 4 

Representative Procedure for Preparing a Sputum Sample for Classification 
30 In this example, a representative procedure for preparing a sputum sample for 

classification by the system and method of the present invention is described. 

A sputum sample obtained as described in Example 2 above is prepared for 
classification as outlined below: 
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1. Transfer the specimen to a centrifuge tube and rinse the original specimen 
container with a few milliliters of standard fixative (prepared as described in 
Example 3), transferring the rinse to the centrifuge tube. 

2. Centrifuge at 1000 g for 10 minutes. 
5 3. Discard the supernatant 

4. Resuspend the celt pellet in 30 ml of DTT fixative (prepared as described in 
Example 3). Vortex to mix and allow to stand for 60 minutes. Vortex after 
30 minutes to ensure mixing. 

5. During this time and centrifuge times, prepare 6 to 10 high adhesion 
10 microscope slides (3-5 pairs) for analysis. 

6. Washing step. Centrifuge at 1000 g for 10 minutes. After centrifuging, 
discard the supernatant, and resuspend by vortexing the cell pellet in 30 ml of 
standard fixative. Centrifuge again at 1000 g for 10 minutes. Discard the 
supernatant from the pellet without disturbing the pellet. 

15 7. To the cell pellet, add enough standard fixative to produce 6-10 drops. 

8. Vortex each tube until homogeneous to resuspend the cells. 

9. Using a 1 ml disposable transfer pipette, place one drop of mixed cell 
suspension in the center of a high adhesion microscope slide. 

10. Take the paired slide and place face down on the first slide and gently press 
20 together, then draw gently across in a pulling motion. The object is to achieve 

a smooth monolayer of cells. Do not allow the specimen to collect at the end 
of the slide. 

11. Air-dry slides completely to reduce the risk of cross-contamination prior to 
analysis. 

25 Slides as prepared as described are then stained by a method such as described 

in Example 1 above. 

After staining, the slide is coverslipped. Coverslipping involves placing a 
mounting medium (e.g., xylene mounting media such as Cytoseal available from VWR 
Scientific or Permount available from Fisher Scientific; or an immersion oil), which is 

30 usually soluble in xylenes, onto the specimen as a drop or two. A thin piece of glass, 
the coverslip, is then placed on top of the slide-specimen-mounting media. The 
mounting media spreads out between the slide and coverslip. Air bubbles must be 
avoided. The mounting media is manufactured such that it matches the refractive 
index of the glass used in the slide and coverslip. This combination is allowed to atr- 

35 dry at room temperature, usually overnight, but at least long enough for the mounting 
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media to solidify. This time may be as short as one hour. For slides that use an 
immersion oil as mounting media, no solidification occurs. Slides prepared as 
described above are ready for analysis and classification by the automated classifier 
system of the present invention. 

While the preferred embodiment of the invention has been illustrated and 
described, it will be appreciated that various changes can be made therein without 
departing from the spirit and scope of the invention. 
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The embodiments of the invention in which an exclusive property or privilege 
is claimed are defined as follows: 

1. A method for detecting epithelial cells in a cell sample, comprising the 
steps of: 

a. obtaining a cell sample; 

b. fixing the cells of the cell sample; 

c. staining the cells to identify cell nuclei in the cell sample; 

d. illuminating the sample and obtaining an image of the sample with a 
microscope and a digital camera; 

e. compensating the image for variations in background illumination; 

f. analyzing the image to detect objects of interest; 

g. determining a focus setting for each object of interest and obtaining an 
image of each object of interest at its determined focus setting; 

h. calculating an edge that bounds each object of interest; 

L calculating a set of feature values for each object of interest; and 

j. providing the set of feature values to a first classifier that identifies 
epithelial cells in the objects of interest. 
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